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(57)Abstract: 

PURPOSE: To obtain an image processing device 
which can electrically compensate the amount of 
deviation of the light axis of a stereo camera, realize 
cost down, at the same time, allows adjustment to be 
made easily, and uses the stereo camera which less 
changes with time and has a high reliability. 
CONSTITUTION: The device is provided with a stereo 
camera 100 with a pair of video optical systems and 
an image processing device 200 for processing a pair 
of image signals G obtained from the stereo camera 
100. The stereo camera 100 is provided with a means 
6 for storing the amount of deviation for storing the 
amount of deviation (i. j) of the light axis in horizontal 
and up/down directions for light reception elements 2 
inside the video optical system. The image processing 
device 200 is provided with an image memory 7 for 
storing a pair of image signals obtained from the 
stereo camera 100 and a means for compensating the 
amount of deviation by operating the address of the image signal on the image mem 
according to the amount of deviation. 




o 



Q 



O 
O 



cry 7 



(l9)B*12#it<t ( J P) 



(A) 



^^m.^ 6-273172 

{AZ)^^mB W-f^Si^ (1994) 9^300 



B 

151; int. LI. 


fib ui( 53 ^ r=T= ¥5 IS S 
aUi ^'J bC ^ /T PJ 3£ -fli- ^ 


F I 




GOIC 3/06 


V yuuoir 






GOIB 11/00 








H04N 5/232 


E 












|f^3Sc0^5 OL {±7M) 


(21)ffili## 


^mW- 5-60192 


(7l)tiilSIA 


000006013 










(22)£iJJ||B 


¥fi&5^ (1993) 3^19B 




:^^iK=F«:BaB:)tL<50F^^T@ 2#3-^ 






(72)%B^^ 
























(74)ftSA 





(54) CI|B^tfO^^>] ::^T-l/^:^^ ^ Srfl3v^/^M^3i5S^© 
(57) i^m] 

[@6<J] wCO^H^ti, X7^U;4-;i?> -^O^IfiO-f 

^G^r^sa^-r-SM^a^&S^^a 0 0 i: ^ilt . 
^7\^^Rx/±T:ff\^<r>yt^(0'rtLM ( i , j ) $:Eli-r 




( 

1 

mimm^m^mit. mti^'ru^:^ :< y^^ h^htit 
0 %<7y-'n^mti^ixm.rz\'t'r h Ltzr k w^^^^MiEis 

:><yb. mtZXT-l^:^:^ ^ "^^.z^^nhfitz—McomiS^ 

^m\^tzm^^mmm.izn\^x . 

t c ^ -ri. 7K ^ ^ t/f ± T r«a o ^ Ift ^0 r ii S 5: IS 1g ^ -f 
fLSiait^l^h, 1^riS•ri^fi$:1iiEf -S-fixS^SiE^^ 

[ 0 0 0 1 ] 

mmm.^.zm-rh h(r>xh s • 

[0 0 0 2 ] 

x<^mi^cri^ih. mi¥co&m.'^:k^ ^m<^i^mf,zfK<m 



2 ) #^¥6 - 2 7 3 1 7 2 

2 

[ 0 0 0 3 ] m2\±-^^^j:Xr-U:^y^ ^ yco-ncoyt 

^^mmi:^^'rmmmxhD . ncisv^r. i^t/^i i 

ii-l^co^mL 1 JIU^L 1 1 frc^iC trifiS^iXTt:-^ 
cou-yx, 2RX/1 2\iUyX IRX/I 1 S::fhL7t:$^^ 

1 2li, CCD>fp<-v^-b if cOHi^Tcr 

;&-^'Sr'S, ZZX\±. UyXlRX/^^m'^2^'^t^:^ 

[ 0 0 0 4 ] atilx 1 1 tw^-ri>3tli L 1 1 

:^7-[&i<7)ii^ . ei,±uyxi i tc^-TS^ISL i i coJiT 
:^.f6i^ii:^. sti^Tt^^ 1 2 tc^f ^B^i^isi^:frr6i 
o-rtia. Tti^^^^ 1 2 tc^-r ^®^atfo:£*-:^r6jo 

-rixfi, U{i:^3te^^ 1 2 tc^f SMmo±T:^l6lO-r 

[0005] i^, m2coXo^x'r\y^^^y^zX^Wt 
iSi^fttzMiSkiS^it. liJr^co J: 3 twM^fi-^n y h o - 

20 iy^tc^4--r . X. ^^(^Xr-ly^:^ ^yi^zis^^X 
\±, ^j^L^V^7S)^, p^{iltf03fe^^i:^i> UVX 1 IS. 

r/^^m=f-i 2(rznLx . ^mnaRx/e . Mixtc, -r 

[ 0 0 0 6 ] msitn^ioxr-xy^^^ ycr>^nmm:fj 

mt:mm'§-htzisb<nm'mmx'h^ . a\±x^u:^ ^ ;< y 
i,z^^mm^ti^nwii^. o\±nmmAc7^i^Lm. ^\±u 
yxi 1 tci^r ^TtifeL 1 1 (Dnmmm. R\tu/yxi 
1 t-C:>n^mA±x(o^m. f (±i-yx i i co^^^^^gg 
30 d;±nmmm^i>zXh^ytm'=Fi 2±coMm^m^ 
coitLWL-rf^Rxh^ . 

[ 0 0 0 7 ] znx. mmd tmAmmf tcomm. 

[ 0 0 0 8 ] d = f tanS" ( 1 ) 

D = RtanS- — ( 2 ) 

[ 0 0 0 9 ] X, -miiz. 1 2 ^<r)mm^m.<r> 

o^ztnt. 

40 [0010] X= (R/f) X ••• (3) 

[0011] (3)jt(cii5V^-c,X = Di:-r^i:. 
( 1 ) ^Rlf ( 2 ) , <^^7)^{S7!)^Jx^Oi:o . 

[0012] Rtan5= {R/i) yi (4) 
X = f tan^ = d ( 5 ) 

[0013] (4 ) ^RX/ ( 5 ) ^XO . ^ffiL 11$: 
n^mm^fzlfmi^f^ ^ ^^m=F l 2 f tan^^ 

h . t^h. StK^^ 1 2±x'^0 7K¥2itA'±T:^fS]T2a.t/ 




( 3 ) 

3 

c 0 0 1 4 ] ^2s.t>'ii3 ^^m^Ltct^^ . 

[00 1 5] IP^. V>X \ itcgSLTti:. JiT. 10 

C 0 0 1 6 ] icoi: # . ^ffl±<i. 
^i&l:xt±/h$ v^tcoh LT#i. i» . (1) 
(5) j^T'^r J: 3 tc, ±T, ^^:^f^i7)M^fillx h 

[ 0 0 1 7 ] flp^, L 1 1 coiiigti. 1 2 

LX Lt 0 z t i,zy^ h . 

[00 18] 

3 %(n--n<n%^\^ 1 1 \z^^h±X<n'n^^m^^ h 

tzisbirz. mm^^j:^'^i^'^^<^i^z^:^^mm^mm^m\^ 

[ 0 0 1 9] X, -RmmLX t , fllls^fi^'SrP^fiS^iSr 

[ 0 0 2 0 ] z<o^mi±±t^(oxo^j:mmj^^mm'rh 40 

[ 0 0 2 1 ] 




!|^^¥6 - 2 7 3 1 7 2 
4 

xhh . 

[ 0 0 2 2] X. c:<7)%B^coif^3S2 tcf^^;^-r 

> ^ i&fflv^?t:M^3tail^^(i. it*«ltcfcv^T. -fix 

xhh . 

[ 0 0 2 3] X, ^o^s^off^Jaa tc^S^xi/^;^ 
[ 0 0 2 4] X. c:(^^0^<:oif^3l4 t3^s;^f- u^;^ 

2^ t;^ ± T :^ rsi o 5t I* c7) ft a 5: le It -r -f ix fi le s 

[ 0 0 2 5] X. <lc^^53<7)if5RlS5 tC^i»X7"P;=r;i^ 
^ 7 ^fflv^f^M^tiiia^^^li:. 11^314 tc^5V^T . "Til 

[ 0 0 2 6 ] 

> ^ ±,co-n(r>m^m^<r> 3 ^co— :^tc^'r s r H V 
x^r^f^L, m^m^(^^m^z^\^h^n<^^ixm.^n 

[ 0 0 2 7] X. CCO^^BJcOff ^312 tCi5V^Tt±. ®^ 

[ 0 0 2 8] X, :i(r>^^^<nn^ms\,z^\^x\±. 

^*-*^60Bmfi-^tfO 3 'h(r> — 'H^'ffi^tz\'t^ 
C:>^ktzr xxm^:^"^ ^^ztl'^^^h . 
[ 0 0 2 9 ] X. z<r>%^R<r)n^m^\z^\^x\t. 

ixtzmi^m^^m^^mmmzm^-r h . 
[ 0 0 3 0] X. :io^^m<r>n^^s\,zn\^x\±. XT- 

[ 0 0 3 1 ] 




( 4 ) 

5 

Li. Lii. 1. 11, 2 Rx/ 1 2i±m^tmm(o h 

<r)X'h h . 

[ 0 0 3 2 ] I 3\±^^^m=^2.Rlf I 2t)^h^ 

n/::3effiL 1 1 ( i , j ) ^leii-r^-f ixiia 

[ 0 0 3 3 ] "fixS ( i . j ) ti, ^^^^ 

1 2 {::3^f-r-S>3fclft L 1 1 <r>^^BLlf l.T'n^ (112 f^Ict) 

[ 0 0 3 4 ] e!oT , ^5^^^ 1 2 titi. [Il^:^f6l S [Z 20 

[ 0 0 3 5 ] 10 OiiM^fl^G^^l/^-rfLS ( i , j ) 
^di^ti'Thi^.v'V^^ :^ 'yX'h'O . \^ y X ll^lf X i ^ 
^ytm=F2Rx/ 1 2 . r vr 3^t/ i 3 , y 

la^^^e i&iiii.Tv^^ . 3o 

[ 0 0 3 6 ] 7\tX^U^^;<y I 0 Oi3^^%^iXi>-' 

Wiim- GCO^m^^^o CPU . QJiM^fefi^nybn- 
7 5 C P U 8 h ^r^-^ LT-rfta ( i , j ) $r C P U 

[0037] CPU8{±, -ttlMi ( i , j ) tCilG l^TM 

ia>^'J7, C P U 8&l/^AaJ:^^ yr?^-7 x-;^ 9 $r 
[-0 0 3 8 ] <Xi,Z^ EI 2 $:#ff^L=5:7&^^>. IS 1 i^ZfjkLtz 

^2Rx/ 1 2±izmm^ri^miMif,z{±^ ]M\mij{^sa)r 
fit. :^^Rx/±TcomnaRx/ a i,zxhm^i^ts7\fi 

[ 0 0 3 9 ] ^co3^, m^:^\^s izM'rh'rtLM<Dm 
lEti, t^ji^hR^cc, mu^^j:m^mmi.z^ ^ . mi so 




^#g3¥6 - 2 7 3 1 7 2 
6 

tf. mi^±<^nm<7^~j^:b<i^^^firz\Mim±^zitMm'r^ 

[ 0 0 4 0 ] — :^7-. :^^Rx/±Tcr>mn aRx/e\±. ^ 
TtfS^^i 2±-cti7K^^i/±T:^f^Tat^uco^^^i& 

[ 0 0 4 1 ] mm^i^zhhnmmt:Wim'rhm 
-^^ ^^7fe^^2s.i^ 1 2±ftzmm^it^mm(oiL<X7z 
mmiS-Wit^. mmm<o^ytm'F 2 ±x'i± (x. y) . m 

mm<r>^^m^ l 2 JbTIi (x+i, y + J) T^'g>h 
f fL(f. 1 2 60-rfifi(± ( i . j ) fc'Sr 0 . ^ 

1 27!»>i^c7)il^afi-f-Gt2*t-r^^IE^ti, x:^rS] 
tc-i. y:^faitc-ji:^^. 
[0 0 4 2] -rtiA { i , j ) (i. M«Kfi-^3 y hu~ 

y5{zx^. mmifmscDm^^i'zm^^ix. -ftiM.t^ 
mmwLe i^ztzm^tih . zco-rtiM < i , j ) {±, i:^ 

[0043] X7^U;t;?5?;^^100ti:, MmiE^^mm 

m:2 0 0 tmm^fix'mMt<&x^fih t . mm^mm 

^2 0 0 iitfO^T'f'-^^cO^m^r^iirf S . ^-f. x 7^ 
l^^;:?>^100i±. Mm3S5^^^2 0 0 ^^i^tfOtt^tw 
J: 0 , -rnaiS'lt^ll 6 tcfaiS^fL/::^^!: ( i . j) 

^l/®{)lifi-^G$:iliiiJ"r^ • 

[0044] z<^tt^ . rtimi^m^m e i3<'T ^ 
)umx'M^m^tixiD^ . mm. a . j ) ti. mw^^m 

mm.20 0 l,Z V T l,Zl^iti ^ tl h . 

[ 0 0 4 5 ] mm^m^W:2 0 on. m 

miSiii-^G^ , mi^^ 7 ^cr>T V\y :^ ( 1 . 1 ) 
^ (m, n) ^r-eix^ixT-^ t trts^-r^ • ®^ 
3ta^^g2 ooi^cocpu8(±, tif— ^tfoa^fi^ 
Gi7)ffl^?ii^tc J: y)^nm&commTmmR^^i!bhi% 
mmmc^miSLm^G^coj^ (x. y) itznm^hm 

^m<ommm'^G±cOj^t: (x-i. y-J) tliiEL 

xmn^'ifo . 

[ 0 0 4 6 ] ^i7)ffliEM ( - i , - j ) (i, -rtx 

S ( i , j ) i7)T-5^ $r^y>XxU:t^ 7 1 0 0 7b^(^ 

^. m-h. M^^^U 7 7&^^DII^{IijOM^fi^T-:^ ^ 
r :^-feX-r-S^ i: ^ tc. x:^[6itz-i. y :Srf^tw- j Ttftt 

•r ^-t^rrr ^ -t:;^'ti> c h cfc 0 . ^2^ii!ioJ!^^{5M: 
(x. y) tc^n^'fiWi5-ri»r fu-^^ot-^^tIj^;^ 

[0047] ::<7)J:3tC, X7^lx;t^^^l00f^T'. 



( 5 ) 

7 

^'tiRi^zMLxiim^^nd^mfj^^mt^j:^ . mm^ 
t^o 0 4 8 ] mmmz . r^, i rii, Mm^fi 

^^g2 0 0 rtcO-rilfilSiE^f^*^ ®il;<^:y 7 7i?>i^ 10 

T\'\^^miE'rhJ: difZLtzfj^. M^^^y TtcS^afi 
^G^r^m-r^ ttizr h' UXMiELT i, J: v^. 

[ 0 0 4 9 ] z(o^BM(omm2 im^ms izMj^i-r 

tCfcvV-c. C PU 8 F^O-rtlSffllE^gii. mil^: 
;^-r ^ 1 0 0 ;&>i^^|fi<7)-f fta 

(i, j) (r>^-:$^ ^^mtX^^hcOT. Xr-\y^^^ 

y 1 0 ot-^m^tix ^ tzMiMim^Gcov'-^ ^ , mm 

^"^V 7 i,z1(^LXmt]t-^yi:^{^i,z i^m. y1f\^izj 

m^tzifr^-^xmrn-r^. 20 
[ 0 0 5 0 ] Bp^. mmmcomiSim'^Gi^zmLx . x:^ 

m<0 1 i - 1 ^T. Mt^^tc, y :^fS]0 1 ^ij— j - 1 5?iJ 

^T-OT^-^'iij^T-r , rKu>i. (i. j) tcffi^-r-2> 

m Ltthi^h . J^T. ®^Rfi-^G(?or ( i , j + 

(1. 2) tC^^L. ;®t^tcM^S(t#G<7)r H U::^ 
<m. n ) tCffi^f -S^X-:?^ ^Mm^ ^: 'J 7 F^OT K U 

X (m - i . n - j ) itzi^m-r^ . 
c 0 0 5 1 ] ^-^-c, mmmcommm-^-Gi,zmi-hmiMi 30 

;<^U 7^^^CfcV^T, m - i + 1 ^T;&*^>m^TiLT'(±W^S«l 
f'J^r i^^'S:-r-:J^(±^^^£L'5rV^, CicOi^-^. CPU 

tii!b(Dmni,zii^ ^ u 7 ^ct) 1 nt^^m - i ^ 

[ 0 0 5 2] ^Sfe^j3 . X, ±i^^mmm 1 ^^i/hm^j 
2-cfi:, -rixfiiiiE#P5^c p u 8 i*itcistt. mm^m 
^m2 0 o[*icoMiii>^ y 7 (c^-r-sr Ki^xiiiEiif^ 40 

$r^T-:'7t:;&<. "fitfi^ijE^^ $r x x 1/ ^ ^ 1 0 0 

j ) ^tzifwiE^titzmmm-^G^mmmmmm2 o o 

izmii!,^h. 

[0053] ID^. :^r-U:^:^ y I 0 O^^CO-fflRn 

s(i. J ) rz\f^ ^ ^ y^^r ^ Lxmiiimmmw2 



6-273172 

8 

f7)T-:^ . KttCTtlSL 1 1 co-f iia ( i , j ) $:?iiE 

[ 0 0 5 4 ] mL\f. '^ytm^F 1 2 ±60 X y:^f^cO*ffi 
Lllco-fiifi^ (i. j) t^tli^. Ky3\^coM^<r> 

ini)^^ i - I n^xcomiSim-^Gi:^ ^-m-^-t 

yiTi^com^co j mi)^ ^ j - mtxcomm^m 
^G^r^-m-^t Lx . mm^m^m2 o oi^z^^m-r 
^, ^Lx . ifr. j m-hT a , j) on 

mfi-f- Gf)^^ ^ 1 . 1 M . fiO ^ r K X ( 1 . 1 ) 

^^i^hmmm^G^mm^m^m2 o o tci^as-rs . 

[0055] ClfLtCiO. 2 0 0 <i . 51^ 

(or}^uxmxmmm^G^mm^'ev 7pm,zmmL. 

[ 0 0 5 6 ] X, ^tiMum^^e t^i.z-rtimmiE^ 
mm2 0 o^i^m-r^ztfj^vt^ ^ . 

[ 0 0 5 7 ] 

[%H3c75^m] iiX±cnxoizzco%B]^(7)m^mii>z^ti 
miii9i}tm^m,t^mt. x^vit^ ^ y\±. e-f^5fe^ 

cor H UX^^f^ LT-rtlMi&^iEf ^-f ixJI^IE^S 

[ 0 0 5 8] X. c:c7)^B^c7)lf^3I2 tc J:tT.(f . ff^ri 
r :^-fex-rs J: •? tc L;^v:60-C', x^u it t ^ v (r>±m<D 

-rixm,-^m.%^^zmiE^h:iti)^x^ . z^xhr^y^ 
mm-t^ t^irz. mmf)<^M-x'K-:>i^^^'i\:t<^^<mm 

[ 0 0 5 9 ] X, C(7)^^03(^ff5R3l3 tC J:fL(f . li^II 

$:-f ixS/::tt-f L/ct KUXcoMi)^^ ^ V ^i^zmmT 

^^izmiE-t ^ z tt<x^ . axhy^y^mmTht 
^tc. m^f)^f^mxKr>i^^^itf2<y'^< m^R^com^^x 



( 

g 

[ 0 0 6 0 ] X. ^CO%B^c7)ii*^4 -^co 
^ ^ t w f -S* * ^ l/f ± T f6j c7) 3t <;o -f S IB e ^ 

^hh^^z. Xv'\y:^t?^v<7^±m<n^ixm.t:n%^^z 
P IE ^ * T' E. o g ^ ^ -f fc =5: < ^ S i=o V ^ -f ^ 
{0 0 6 1] X. Ccol60^fiOf9^3S5 . 



[^2 ] 




6 ) #ffl¥6 - 2 7 3 1 7 2 

10 

[HI] ^<!0%H^^O^;Ei£^Jl ^r-^H^fi^tc^^yn-/ 
[112] -m.m^xX'rX^^:^ :< y<7y%'^^^7T^'tWt^m 

1,11 Ix- 
10 2,12 

6 -f ixSiSe^M 

7 am^^'j 

8 C P U 

10 0 X-r W:t;<?> ^ 
2 0 0 M«5lil^^S 
G M^fi# 

T 7K¥:^rai 
u ±T:^rsi 

20 ( i . j ) -rn:! 



[il3 ] 




A 



( 7 ) 



If - 2 7 3 



till ] 




K mail 

=: Oil m r:::. 
.- - •• 

— OJ CD 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SffiES 



□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




ADED TEXT OR DRAWING 



